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20\  ABSTRACT  (Continue  on  ravaraa  aide  If  neceeeary  and  identity  by  block  number) 

^ Conventional  spectral  analysis  methods  do  not  describe  the 
distribution  of  signal  power  in  both  time  and  frequency.  Time 
dependent  Fourier  transforms  are  defined  to  extend  the  conven- 
tional theory  to  include  instantaneous  energy  and  power  spectra 
for  the  past  and  future  signal.  These  spectra  are  combined  to  . 
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20.  (contd) 

define  a generalized  instantaneous  power  spectrum  (GIPS)  of  the 
entire  signal.  The  Sliding  FFT  method  of  calculating  the  GIPS 
is  examined  and  the  equivalence  between  the  estimates  for  the 
real  and  analytic  signal  is  shown.  These  methods  are  applied 
to  nonstationary  stochastic  processes  and  the  GIPS  is  shown  as 
given  by  the  Fourier  transform  of  Loeve's  generalized  power 
spectrum  of  the  process  and  to  be  the  generalization  of  the 
Wiener-Kintchine  theorem  to  nonstationary  processes.  It  is  also 
shown  to  represent  the  stationary  process,  the  locally  station- 
ary process,  and  the  deterministic  process.  In  addition  to  the 
GIPS,  i.e. , the  spectral  mean,  an  expression  for  the  spectral 
covariance,  is  given  and  the  relationship  between  these  func- 
tions and  a GIPS  estimate  via  an  ensemble  of  Sliding  FFT  cal- 
culations is  examined. 


SUMMARY 


Problem:  Develop  spectral  relations  for  analyzing  processes  having  time 

evolving  spectra. 

Results:  Power  spectral  relations  for  nonstationary  processes  have  been 

developed  that  generalize  the  Wiener-Kintchine  relation  for  stationary 
processes. 


Recommendations:  Extend  this  analysis  to  include  the  relations  between 

ensemble  processing  and  sequential  processing  for  nonstationary  processes. 
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I.  INTRODUCTION 

Spectral  decomposition  by  Fourier  transformation  is  a useful  method  of 
analyzing  the  transformations  that  signals  undergo  during  generation,  trans- 
mission, and  reception.  However,  these  methods  are  only  in  a partial  state 
of  development  since  they  are  not  capable  of  describing  the  time  evolution 
of  the  energy  distribution  in  frequency  of  even  the  simpler  signals  that 
are  encountered  in  everyday  experience.  We  investigate  these  deficiencies 

in  some  detail  and  formulate  improved  methods.  These  formulations  relate 

1-13 

and  extend  the  work  of  a number  of  earlier  investigators. 

Representin':  the  signal,  s(t),  by  the  Fourier  transform  relations 


s(t) 


fc  $ 


S (w)  exp(-i  uit)  dw 


(la) 


S(u) 


s(t)  exp(i  wt)  dt 


(lb) 


- • 


: 


we  note  that  the  signal  can  be  viewed  as  a superposition  of  sinusoids  having 
a range  of  frequencies,  phases,  and  amplitudes.  This  interpretation  is 
given  more  substance  by  Parseval's  relation 


s^ (t)dt 


m: 


S(oj)  dtu, 


(2) 


in  which  the  left  member  is  the  signal  energy  and  the  integrand  of  the  right 
member  gives  the  energy  per  Hz  and  is  called  the  energy  spectrum.  The 
usefulness  of  this  decomposition  for  analyzing  signal  transformations  is 
well  known  and  has  been  thoroughly  explored  in  many  publications.  The 
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narrowness  of  these  concepts  can  be  appreciated  by  considering  the  sound 
generated  by,  say,  a symphony  orchestra  or,  more  simply,  a siren.  If  these 
signals  were  analyzed  by  the  above  methods  the  resulting  energy  spectrum 
would  not  describe  the  observers  feeling  that  the  signal  is  varying  in  fre- 
quency and  time  simultaneously.  This  lack  of  time  dependence  in  conven- 
tional spectral  analysis  methods  can  be  eliminated  by  means  of  recently 
developed  methods. 

Following  a brief  discussion  of  signals  and  their  power  and  energy 

relations,  the  approach  to  a time  evolving  spectra  is  presented  via  the 

running  Fourier  transform  that  was  originated  by  Page'*'  and  extended  by 
2 

Levin.  We  develop  their  definitions  for  the  deterministic  signal  and  re- 
late the  resulting  generalized  instantaneous  power  spectrum  (GIPS)  to  the 
sliding  FFT  output.  These  concepts  are  then  extended  to  the  general  case  of 
nonstationary  stochastic  signals  by  a method  similar  to  Lampard's.  It  is 

shown  that  the  resulting  GIPS  of  a nonstationary  process  is  given  by  the 

4 

Fourier  transform  of  its  generalized  power  spectral  density  and  also  in- 
cludes the  well-known  stationary  case,"*  i.e.,  the  Wiener-Kintchine  theorem, 

6 2 7 

the  locally  stationary  case,  and  the  deterministic  case.  ’ In  addition, 
the  spectral  variance  of  the  process  is  shown  to  be  bounded  by  the  double 
Fourier  transform  of  the  covariance  of  the  signal  covariance  estimate  and 
both  the  GIPS  estimate  and  its  variance  are  related  to  the  Sliding  FFT 
output. 

An  earlier  approach  to  the  problem  of  time-frequency  representation  of 

g 

a signal  was  given  by  Gabor.  He  represents  the  signal  in  terms  of  a double 
sum  of  elementary  signals  that  are  distributed  in  time  and  frequency.  The 
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coefficients  in  the  sum  are  evaluated  by  an  iterative  method  and  these 

coefficients  represent  the  time-frequency  spectrum.  This  method  gives  good 

insight  into  the  distribution  of  signal  energy  in  time  and  frequency  but  is 

not  a rigorous  definition  of  the  time  dependent  spectrum  because  the 

g 

elementary  signals  overlap.  Helstrom  discusses  an  analogous  integral 

10 

representation  having  this  same  deficiency  while  Montgomery  and  Reed 
generalize  this  integral  representation  to  include  a broader  class  of 
elementary  signals.  It  will  be  seen  that  their  generalization  is  equivalent 
to  the  method  of  Page  for  the  appropriate  class  of  elementary  signals. 


i 
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II.  DETERMINISTIC  SIGNALS 
A.  Signals,  Power  and  Energy 

Deterministic  signals  can  be  represented  in  the  real  form 

f(t)  = x(t)  cos  co^t  + v(t)  sin  u^t 


= A(t)  cos(wQt  - <+)  ( t) ) (3) 


where  it  is  convenient  to  assume  that  the  quadrature  components  are  low 
passband  functions  that  are  limited  to  the  band  ±W/2(W/2  _<  f^  = Wq/2tt) 


/■ttW 

x(t)  = ^ 

3-7TW 

X(co) 

exp (-i 

cot)  dco 

(4a) 

/.  TIW 

y(t)  - ^ 

3 — 7TW 

Y(co) 

exp (-i 

cot)  dco 

(4b) 

and  the  envelope  and  phase  are  given  by,  respectively. 


A(t)  = [x2(t)  + y2(t))1/2 

(5a) 

4> ( t)  = arctan  [y(t)/x(t)]. 

(5b) 

The  Fourier  transform  of  this  signal  can  be  expressed  in  terms  of  the  quad- 
rature component  transforms 


F(co)  = j [X(w-u>0)  + i Y(u-u>0)]  + j [X((v4^0)  -i  Y (u+cOq)  ] 


(6) 


4 


where  the  first  term  vanishes  for  negative  frequencies  and  the  second  term 
vanishes  for  positive  frequencies. 


The  power  of  the  signal  is  given  by 


P(t)  = f2(t) 

= jA2(t)  + j [ (x2(t)  - y2 (t) ) cos  2gl)q t 


+ 2x(t)  y (t)  sin  2w0t], 


(7) 


i.e. , if  f is  voltage  then  P is  the  power  dissipated  in  a unit  resistance. 
This  equation  shows  that  the  power  contains  a part  that  varies  slowly 
compared  to  the  carrier  frequency  and  a part  that  varies  at  twice  the  carrier 
frequency.  It  can  also  be  shown  that  the  contribution  of  the  oscillatory 
term  to  the  total  energy  vanishes 


E 


P(t)  dt 


1 

2 


A2 (t)  dt. 


(8) 


i.e.,  the  oscillatory  integrals  are  shown  to  vanish  by  substituting  from  Eq.  4, 
integrating  the  delta  functions,  and  noting  that  the  products  of  the  form 
U^(oj)  ± w)  vanish.  This  relation  shows  that  only  the  first  term  in 

Eq.  7 contributes  to  the  total  energy  of  the  signal  and  is  the  effective  power 
of  the  signal  while  the  second  term  contributes  nothing  to  the  total  energy 
of  the  signal  and  is  the  reactive  power  of  the  signal,  i.e.,  that  part  of  the 
energy  flow  that  is  stored  in  the  reactive  elements  of  the  system  or  medium. 
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Since  the  reactive  power  does  not  contribute  to  the  net  flow  of  energy  it  will 
be  convenient  to  ignore  it  in  the  following  and  to  consider  onlv  the  effective 
power  of  the  signal. 

Deterministic  signals  can  also  be  represented  by  the  complex  analvtic 

signal 


s(t)  = m(t)  exp (-i  WQt)> 


(9) 


where  the  complex  envelope  is  related  to  the  quadrature  components  by  the 
expression 


m(t)  = x ( t ) + i v(t).  (10) 

This  representation  is  frequently  useful  because  it  simplifies  many  calcula- 
tions. The  real  and  imaginerv  parts  of  the  analytic  signal 

f(t)  = Re  s(t)  (11a) 

f(t)  = Im  s ( t ) (11b) 


represent,  respectively,  the  real  signal  and  a quadrature  signal  that  is 
phase  shifted  by  tt/2  radians.  The  envelope  and  phase  of  both  signals  are 
obtained  from  the  complex  envelope  by  the  expressions 


A(t)  = |m(t);2 


(12a) 


<}>(t)  = arg  ra(t). 


(12b) 
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The  Fourier  transform  of  the  quadrature  signal  is  given  by 


I 


F(to)  = \ [Y(a)-w0)  -i  X(u-O)0)]  + y [Y (w+Wq)  +i  X(ortw0)] 

= i sgn(w)  F(to)t  (13) 

where 

sgn(to)  = ± 1,  to  > 0 (14) 

and  the  Fourier  transform  of  the  analytic  signal  is  given  by 
S (co)  = F(to)  + i [i  sgn(co)  F(co)  ] 

= 2 U(to)  F(to), 

where 

U(to)  =•  1,  to  > 0 
= 0,  to  < 0 

which  is  just  twice  the  real  signal  transform  for  positive  frequencies  and 
zero  for  negative  frequencies.  This  property  of  the  analytic  signal  is 
frequently  useful. 

The  real  signal  power  can  be  expressed  in  terms  of  the  analytic  signal 
by 


(16) 


1 

i 

I 

« 

(15) 
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= t (s(t)  + s*(t))/2r 


\ I S (t)  I 2 + i (s2(t)  + s*2(t)). 


where  the  superscript  asterisk  denotes  complex  conjugate  and  the  terms  can  be 
shown  to  represent,  respectively,  the  effective  power  and  the  reactive  power. 
Consequently,  the  effective  power  of  the  real  signal  can  be  obtained  from  the 
modulus  of  the  analytic  signal. 


B.  Deterministic  Spectra 

The  energy  of  a signal  is  distributed  in  both  time  and  frequency  and  at 
any  time  t is  a function  of  only  the  signal  in  the  past  since  the  future  of 
the  signal  must  be  considered  arbitrary.  One  approach  to  estimating  this 
distribution  is  to  pass  the  signal  through  a bank  of  bandpass  filters.  The 
impulse  response  of  one  such  filter  in  the  bank  is  h(t)  cos  wt  and  the 
filter  output  is 


g (t,  w) 


f(x)  h(t-i)  cos  [ oj  ( t— x ) ] dx. 


For  the  bank  of  filters  the  collection  of  functions  g (t,  u>)  provides  a means 
of  estimating  the  distribution  of  signal  energv  in  time  and  frequency.  We 
note  that  the  filter  bank  is  not  necessarily  a comb  filter  in  which  the 
individual  filter  bandwidths  are  nonoverlapping. 

The  effective  power  of  each  filter  output  can  be  found  by  a quadrature 
demodulation  to  obtain  the  envelope  of  the  output.  The  quadrature  components 


■ I 
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0f  g~(t,  w)  are  found  by  multiplying  Eq.  18  by  2 cos  ut  and  2 sin  wt , 
(where  the  factors  of  2 arc  required  to  preserve  the  output  power)  and  the 
terms  at  frequency  2oJ  are  eliminated  by  filtering 


x (t,  u>) 


y (t,  w) 


f (t ) h(t-x)  cos  0)X  dx 


f(x)  h(t-x)  sin  uix  dx. 


(19a) 


(19b) 


The  complex  envelope  of  this  output  is  defined  by 


G (t,  w)  = x"(t,  w)  + i y (t,  w) 


(20) 


and  we  obtain 


G~(t , w)  » \ f(x)  h(t-x)  exp (i  cox)  dx.  (21) 

J _oo 

If  the  real  input  signal  were  replaced  by  the  analytic  signal  and  the  real 
filter  were  replaced  by  the  analytic  filter,  h(t)  exp(— i wx) , then  the  output 
would  immediately  be  found  to  be 

G_(t,  oj)  = ^ s(x)  h(t-x)  exp(i  ojx)  dx,  (22) 

where  we  have  heterodyned  by  multiplying  by  exp(i  ux) . Since  both  Eq.  21  and 
Eq.  22  have  the  same  form  we  can  pursue  this  development  in  terms  of  the 
analytic  signal  or  the  real  signal  merely  by  a change  of  notation.  We  use  i 
analytic  signal  notation  except  as  noted. 
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The  squared  envelope  of  the  output  Is 


I G (t , w) 


s(t)  h(t-r)  exp(i  .jt)  di  j , 


and  if  this  function  is  integrated  over  frequency 


> i' 


| G (t , oj)  I cLo 


-j: 


s 2 (t)  h2 (t-r)  di 


we  find  that  the  result  is  the  total  energy  stored  in  the  filter  at  time  t 
and  that  the  function  |g  (t,  oj)  [ gives  the  energy  distribution  in  frequency 
of  the  filter  output  at  time  t,  i.e  , the  instantaneous  energy  spectrum  (IES) 

The  IES  as  defined  above  is  dependent  upon  the  signal  and  also  upon  the 

choice  of  filter  because  the  impulse  response  selectively  weights  each  por- 
\ 

tion  of  the  past  signal.  We  can  lefine  a spectrum  that  is  dependent  only 
upon  the  signal  by  choosing  a filter  whose  impulse  response  is  nondistort- 
ing, i.e.,  the  unit  step  function 


h(t)  = U(t)  = 1,  t > 0, 


= 0,  t < 0, 


which  gives  equal  weight  to  all  portions  of  the  past  signal. 


The  complex  envelope  becomes 


G (t , cj)  - 


s(t)  exp(i  ujT ) dx, 
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which  is  the  same  as  the  running  Fourier  transform  defined  by  Page  and  which 
can  be  inverted  to  obtain  the  signal  representation 


2 S(t' 


G (t,  td)  exp(-i  u t)  dw. 


(27) 


The  resulting  IES  is  the  running  energy  spectrum  defined  by  Page 


|G"(t,  w)|2 


s(t)  exp(i  wt)  dT 


2 


(28) 


and  represents  the  distribution  of  energy  in  frequency  due  to  the  past 
signal 


00  /»  t 

|G~(t,  w) |2  du  = 1 |s(t) |2" dx.  (29) 

—00  J — oo 

The  case  of  the  filter  dependent  IES,  in  which  a decaving  impulse  response 

11  12 

was  used,  has  been  discussed  by  Fano  and  later  by  Schroeder  and  Atal  as 
a means  of  estimating  the  short  time  spectrum.  Differentiating  Eq.  29  we 
obtain 

G_(t , co)  | 2 du  = |s(t)|2>  (30) 

which  shows  that  the  function 


P (t,  u>)  - | G_  (t , w)|2 


(31) 


is  the  instantaneous  power  spectrum  (IPS)  of  the  signal  as  defined  by  Page 
and  which  is  uniquely  defined  by  the  signal. 
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Expanding  the  IPS  definition  in  Eq.  31  by  means  of  Eq.  28  we  obtain 
Page's  result 

p (t,  u)  = 2Re[s(t)  exp (i  o)t)  G *(t,  w)  ].  (32) 

By  the  previous  arguments  this  expression  represents  the  distribution  of  sig- 
nal power  in  time  and  frequency.  We  note  that,  while  this  power  distribution 
is  always  real,  it  may  be  negative  which  implies  that  the  signal  energy  can 
be  redistributed  in  frequency  as  time  evolves.  We  also  note  that  this  rela- 
tion is  unobservable  since  any  attempt  to  place  a "time-frequency  window"  on 
the  signal  changes  the  preceding  relations. 

The  IPS  and  the  IES,  as  defined,  are  dependent  cnly  on  the  past  signal 
but,  following  Levin,  analogous  functions  can  be  defined  for  the  future 
portion  of  the  signal: 


12 


-fj-  i c+(t , U)i2 


(33f ) 


+ 

P 


(t,  o>)  - 


“ 2Re  [s(t)  exp(i  wt)  G^Ct,  to)  ] . (33g) 

The  minus  sign  is  introduced  into  the  IPS  definition  in  Eq.  33f  because 
of  the  minus  sign  in  Eq.  33e.  These  functions  are  not  directly  measureable 
but  are  useful  because  they  can  be  used  to  define  general  relations  that  are 

valid  for  all  time  and  frequency.  Prior  to  developing  these  general  relations 

_ 2 

we  note  that  the  past  expressions  |G  | and  p are  independent  of  the  future 
+ 2 + 

relations  | G | and  p . The  physical  argument  for  this  conclusion  appears 
to  be  that  the  past  expressions  represent  the  energy  and  energy  flow  re- 
quired to  generate  the  signal  up  to  time  t,  while  the  future  expressions 
represent  the  energy  and  energy  flow  required  to  terminate  the  signal  after 
time  t.  Since  the  past  and  future  portions  of  the  signal  are  necessarily 
independent  the  past  and  future  relations  are  independent,  i.e. , they  do  not 
give  the  same  distributions  at  time  t. 

The  expressions  for  the  past  and  future  running  Fourier  transforms  can 
be  added  to  obtain  the  signal  Fourier  transform 

t 00 

G (t,  w)  + G+(t,  w)  = 1 s(t)  exp(i  arc)  dx 

J -DO 

■ G(aj).  (34a) 

Similarly,  the  sum  of  the  inversion  formulas  gives  the  signal  representation 
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s U ) + s (t  ) 
2 


= M 


[G  (t,  v‘0  + <■'  U,  -)]  exp (-i  ,.'i)  cLj 


-m: 


G(gj)  exp(-i  tot)  du. 


(34b) 


The  sum  of  the  past  and  future  power  relations  vanish 


c 00 

2v  \ ^ft  'G  ^t>  CJ^2  + ft  I2]  ^ 

J —CO 


(34c) 


which  shows  that  the  total  energy  flow  into  the  past  equals  the  total  energy 
flow  from  the  future;  but  we  note  that  this  does  not  imply  that  the  IPS  for 
past  and  future  are  equal  and  of  opposite  sign.  The  difference  between  the 
past  and  future  power  relations 

$00 

[|G_(t,  u)  |2  - |G+(t,  u)  |2]  do)  = 2 1 s (t)  | 2 (34d) 

—CO 

shows  that  we  can  define  the  generalized  instantaneous  power  spectrum  (GIPS) 


p(t,  uO  = [|g  (t,  co)|2  - |G+(t,  to)  |2] 


(34e) 


= Re  [s(t)  exp(i  wt)  S*(w)]5 


(34f) 


which  contains  information  concerning  both  the  past  and  future  of  the  signal. 
This  spectrum  represents  the  power  distribution  for  all  times  and  frequencies. 
The  respective  integrals  of  the  GIPS 
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p(t  , u))  dt  « *S(>o) 


(35a) 


k j: 


p (t , to)  dto 


(35a) 


h\s. 


p(t , to)  dto  dt  = E 


give  the  energy  density  in  frequency,  the  energy  density  in  time,  and  the 
total  energy.  A convenient  method  of  computing  the  GIPS  is  given  in 


Section  D. 


C.  An  Example 


The  example  that  we  consider  is  the  sinusoidal  signal 


s(t)  = exp(-i  Wgt). 


0 < t < T 


0 other  times. 


The  running  Fourier  transform,  IES  and  IPS  for  the  past  signal  are  readily 
found  to  be 


G (t,  to)  = t exp[i(<o-<o0)  t/2]  sine  [ (to-u>0)  t/2  ] 


I G~( t , tu)  | 2 = t2  sine2  [(a™  )t/2] 


p (t,  to)  = 2t  sinc[(to-tof.)t]. 


U » 


0 < t < T. 
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where 


sinc(x)  = sin(x)/x. 


We  see  that  each  function  has  a similar  form  and  represents  a ridge  positioned 
at  the  carrier  frequencv  that  grows  in  amplitude  and  decreases  in  width  with 
time.  This  shows  that  the  bandwidth  of  a sinusoidal  pulse  is  initially  very 
wide  but  that  it  approaches  the  theoretical  limit  of  zero  as  time  increases. 
The  running  Fourier  transform,  IE S and  IPS  of  the  future  signal  are  similarly 
found  to  be 


G (t,  <j)  = T exp[i(u)-Ug)T/2]  sinc[  (oj— ) T/ 2 ] 


- t exp  [ i (to— ) t / 2 ] sinc[  (oj-oJq)  t/2] . 


| G+  ( t , to)  I 2 = T2  sinc2[  (to— <jOq)T/2 ] + t2  sine2  [ (ui-oJq)  t/2 ] 


- 2tT  cos  [ (aj-toQ)  (T-t)  /2] 


x sine [ (w-u)q) T/2]  sine [ (co-aj^)  t/2  ] 


p+(t,  id)  = 2T  cos  [ (cd-cDq)  (T/2-t)  ] sinc[  (cj-Wq ) T / 2 ] 


-2t  cos  [ (dj-cDq)  t/2  ] sinc[  (oj-cDq)  t/2  ], 


0 < t < T . 


Combining  the  IPS  of  the  past  and  future  signal  gives  the  GIPS  of  the  analytic 
sinusoid 


p(t,  go)  = T cos[(w-uj0)  (T/2-t)  ] sine  [ (co-cOg  )T/2],  (40) 

0 _<  t _<  T. 

This  function  has  the  form  of  a ridge  positioned  at  the  carrier  frequency  but 
it  has  constant  amplitude  and  the  spectrum  width  is  nominally  constant. 

D.  Calculation  of  the  GIPS  By  the  Sliding  FFT 

A common  method  of  calculating  the  GIPS  is  to  compute  the  power  spectra 
of  blocks  of  data  windowed  sequentially  from  the  signal.  The  resulting  power 
spectra  are  displayed  sequentially  and  are  assumed  to  represent  cross  sections 
through  the  GIPS  surface.  This  calculation  is  normally  effected  by  the  fast 
Fourier  transform  algorithm  and  the  result  of  the  calculation  is  referred 
to  here  as  the  Sliding  FFT.  We  will  determine  the  relationship  between  the 
Sliding  FFT  and  the  GIPS. 

The  window  to  be  applied  to  the  data  is  assumed  to  be  real  and  even  and 
is  represented  by  the  Fourier  transform 

(41a) 
(41b) 


p(t) 


-fc  V 


P(u>)  exp(-i  cot)  d oo 


P(u>) 


■ $: 


p(t)  exp(i  cot)  dt . 


17 


Extracting  the  block  of  data  from  the  interval  t - T/2  <_  t ' <_  t + T/2  its 
oover  spectrum  estimate  at  time  t is 


p(t , to)  = | F(t , -j) 


dt  ” p(t")  f(t'+t)  exD  (i  tot')|  , 


where  we  are  assuming  th  .t  the  Sliding  FIT  is  applied  to  the  real  signal. 
Repeating  this  calculation  for  a sequence  of  times  t gives  the  Sliding  FFT 
estimate  of  the  GIPS. 

The  relationship  between  the  Sliding  FFT  and  the  GIPS  can  be  determined 
by  transforming  Eq.  42  by  substituting  the  appropriate  Fourier  integral 
relations  to  obtain 


p(t,  to)  = 


dt " dui'  [Pp*(t"-t,  Pf(t',  u>0]. 


where 


Pp(t,  u)  = p(t)  exp(i  cot)  P*(co) 


(43b) 


Pf(t,  to)  = f(t)  exp (i  cot)  F*(co). 


The  convolution  in  Eq.  43a  shows  that  the  Sliding  FFT  produces  a smoothed 


estimate  of  the  GIPS  in  which  the  smoothing  window  is  the  GIPS  of  the  data 
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window.  An  estimate  of  the  effects  of  the  smoothing  can  be  found  by  estimat- 
ing the  size  of  the  t-vj  cell  on  which  the  GIPS  of  the  window  is  significant. 


The  location  of  the  cell  is  given  by  the  weighted  averages 


Re 

2ttE 


\s 


dt ' dw'  t'  P (t'-t,  co'-to) 
P 


fc  ss. 


dt"  do'  w"  P (t'-t,  w'-w) 
P 


1/2 


— 2 — 2 

The  size  of  the  cell  is  given  bv  [ (oj-co)  (t-t)  ] where 


(co— Ol)  ^ 


(t-t)2 


Si  \S 


2 > 

dt ' dLo"  (gj'-gj)  Pp(t'-t,  w'-w) 


^ dt  ' p(t  ')  p (t ')  /E 

J -CO 

c 00 

\ dt'  | p(t  ')  | 2 / E 

J —CO 


■ ss 


dt'  dw'  (t'-t)2  Pp(t'  -t,  u'-*j) 


f °° 

\ dt' t'2|P(t') |2/e  , 

J -CO 


(44a) 


(44b) 


(45a) 


a5b) 
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where  the  dots  in  Eq . 45a  denote  derivatives.  The  integrals  can  be  evaluated 
from  the  relation^ 


dt'  t'  p(t')  p(t") 


= -E/2. 


Transposing  and  squaring  we  obtain  the  bound 


0 = [1/2  + V dt'  t'  p(t')  p(t')/E]' 


= (\  dt ' t'  p(t')  p(t')/E)  - 1/4 


dt'  t'"iP(t')|2  | j 


dt  ' | p(t  ')  | 2 


Substituting  from  Eq.  45  we  obtain  the  cell  size  expression 


[(u-w)2  (t-t)2]  > 1/2. 


We  abbreviate  this  AwAt  >_  1/2,  where  At  corresponds  to  the  window  length  and 
Aw  corresponds  to  the  spectral  resolution.  We  note  that  the  fast  Fourier 


transform  does  not  achieve  the  minimum  resolution  Aw  = l/2At. 
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For  the  minimum  cell  size  (which  can  be  obtained  with  the  gaussian 
2 

window,  exp(-at  )),  the  Sliding  FFT  is  approximated  by 


P(t,  to) 


Re 

2tt 


t+At 

r 

to+Ato 

JL 

J 

to-Ato 

dt'  dto'  f(t')  exp(i  to'  t')  F*(to'), 


(49 


where  AtAto  ■ 1/2.  If  the  signal  modulation  and  the  Fourier  transform  are 
slowly  varying  over  the  domain  of  the  window  they  can  be  approximated  as 


n(t')  “ m(t)  exp [-i  tot(t'-t)]  (50a) 

F(to')  = F(to)  exp [-i  (to'-to)  t ],  (50b) 


where  <0^  and  t^  are  the  mean  slopes  of  the  phases  of  the  modulation  and 
Fourier  transform  over  the  cell.  The  instantaneous  frequency  of  the  signal 
at  time  t is  t0g+<ot  and  the  time  shift  of  the  Fourier  component  at  the 
frequency  to  is  t^.  Equation  49  becomes 


p(t,  to) 


t+At  to+Ato 

m(t)  F*(to) 

t-At  to- A to 


dt ' dto'  exp[i  (to'-to^H' 


-i  to  (t'-t)  -i  (to'-to)  t ] 
t *00 


+ m*(t)  F* (to) 


t+At  to+Ato 

/ / 

t-At  to-Ato 


d't ' dto'  exp[i  (to'+t0g)t 


+ i to  (t'-t)  -i  (to '—to) t J 


(51) 


and  we  note  that  the  first  term  represents  the  Sliding  FFT  applied  to  the 
analvtic  signal  while  the  sum  of  both  terms  represents  the  Sliding  FFT 
applied  to  the  real  signal.  The  integrals  in  the  expression  can  be  transformed 
bv  the  variable  changes  t"  ~y  t+t' , co"  -*■  gj+u)"  to  obtain 


t+At  to+Ao) 


r = j j dt"  du) " exp [i  (u>"  t u)Q)t"  ± i wt(t"-t)  -i  (u'-aOt^] 


t-At  (jO-Ati) 
At  Au 


= J*  j dt " du)"  exp [ i (00+00^+00 ")  (t+t")  ± i cot  t"  -i  wt^]  . (52) 


-At  -Ato 


Expanding  the  product  in  the  exponent  and  replacing  the  factor  containing 
CO ""  t"  by  its  Taylor  series  (for  our  purposes  it  is  sufficient  to  retain  just 
the  first  term)  we  obtain 


I-  = exp 


rAt 

[i  (u±u)Q)t]  J dt"  exp [ i (u±a)0±tJt)  t"] 


du)"  exp[i  to"(t-t  ) ] 


= 2 exp[i  (w±Ug)t]  sinc[  (w±ujQ±cot)At]  sinc[  Aw(t-t^)  ] . 


With  these  expressions  the  Sliding  FFT  becomes 


p(t,  u>) 


[s(t)  sinc[  (cj-Uq-oj  )At]  + s*(t)  sine [ (w+GJg+t^) At ] 


* exp(i  tot)  F* (oj)  sinc[Aco(t-t  )]  . (54) 

co  l 


In  this  expression  the  first  term  dominates  on  the  positive  band  of  frequencies 
and  the  second  term  dominates  on  the  negative  band  of  frequencies.  Restricting 


ourselves  to  just  the  positive  band  of  frequencies  we  obtain  the  Sliding  FFT 
expression 

Dp 

p(t,  u)  - — [s (t)  exu (i  u> t)  F*(w)] 

x sinc[ (cj-ojp-wt) At]  sincfAuj(t-t^)  ],  (55) 

which  is  a faithful  reproduction  of  the  GIPS  in  the  region  of  dominant  signal 
activity  (u>  *»  + u)  , t = t^)  but  which  is  distorted  elsewhere.  This 

expression  shows  that  the  Sliding  FFT  of  the  real  signal  has  approximately 
the  same  form  as  the  Sliding  FFT  of  the  analytic  signal.  Consequently,  it 
follows  that  a theoretically  derived  GIPS,  based  upon  the  analytic  signal, 
can  be  compared  directly  to  the  Sliding  FFT  of  the  real  signal.  This  is  an 
important  result  since  analyses  involving  the  analytic  signal  are  generally 
simpler  than  those  involving  the  real  signal  while  the  Sliding  FFT  is  more 
easily  applied  to  the  real  signal. 
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III.  STOCHASTIC  PROCESSES 


! 


* 


f 


( 


A.  Harmon! zabili tv  Theorem 

A more  general  class  of  signal  than  the  deterministic  signal  is  the 
class  of  stochastic  signals.  We  consider  the  class  of  harmonizable  stochastic 
signals  of  Loeve^,  i.e.,  second  order  random  functions  s(t)  are  harmonizable 
if  there  exists  a second  order  spectral  decomposition  of  s(t),  denoted  g(u>), 
such  that 


s (t) 


1_ 

2rr 


exp(-i  cot) 


dg(oj). 


(56) 


The  covariances  of  these  functions  are 
T(t,  t')  = E[s(t)  s*(t')] 


(57a) 


Y(u,  u')  - E[g(u)  g*(co')] 


(57b) 


and  we  note  that  the  time  dependent  effective  power  of  the  process  is  given 
by  T(t,  By  Loeve’s  harmonizab ility  theorem  we  obtain  the  covariance 

relation 


r(t,  O 


(l-)2 


exp[-i 


(u)t  - u'  t ')  ] dd'  y(<*>,  w')  . 

(58) 


These  Fourier-Stielt jes  integrals  can  be  simplified  to  Riemann  integrals  by 
assuming  mean  square  differentiability  of  the  spectral  decomposition  of  s(t) 


dg(co)  « G(u))  du). 


(59) 
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A 


and  the  signal  representation  and  its  inverse  formula  become 


exp(-i  u>t)  G(u)  da) 


exp(i  tot)  s(t)  dt, 


(60b) 


where  G(w)  is  the  random  Fourier  transform  of  the  signal.  Under  the  mean 
square  differentiability  assumption  the  integrator  in  the  covariance  relation 
becomes 


dd'  y(w*  w")  ■ E[dg(uj)  d'  g*(u)')] 


E[G(w)  G*(w')]  dui  dw' 


- Y((0,  u>')  cki  du' t (61) 

where  T (to , u>')  is  Loeve's  "generalized  power  spectral  density"  of  the  process  and 
the  covariance  relation  and  its  inverse  relation  become 

T(t,  O « (-^j-) 2 exp [-i  (tot  —to ' t')]  H'(a),  u>')  do)  du'  (62a) 

Y(u),  u>')  = |j  exp[i  (ut-o)'  t')]  T(t,  t')  dt  dt'.  (62b) 

The  covariance  relations  in  Eq.  61  show  that  the  spectral  components  in 
disjoint  frequency  bands  are  correlated,  which  in  the  context  of  time 
evolving  spectra  appears  to  imply  that  on  the  average  energy  may  be 
transported  between  these  bands;  i.e.,  that  the  ensemble  power  spectrum 


is  time  evolving.  The  time  dependence  is  not  apparent  in  Eq . 62  but  in 
the  following  we  develop  this  viewpoint  and  show  that  the  GIPS  of  the 
process  is  given  by  the  Fourier  transform  of  the  covariance  function,  i.e., 
the  generalized  Wiener-Kintchine  relation,  or  the  Fourier  transform  of 
Loeve's  generalized  power  spectral  density.  Two  cases  of  special  interest 
will  be  considered  prior  to  this  development. 

B.  Two  Special  Cases 

1.  Wide  Sense  Stationary  Processes 

For  the  classical  case  of  wide  sense  stationary  processes'*  the  covariance 
function  depends  only  on  the  time  differences  and  not  on  the  absolute  time 

r(t,  o = r(t-t').  (63) 


The  generalized  power  spectral  density  in  Eq.  62b  becomes 


f(o> 


exp[i  (cot  — oo ' t ')  ] F(t-t^)  dt  dt 


* OO  i*  00 

= \ exp[i  (oJ-oj')t^]  dt^  I exp(i  gjt)  r(x)  dx 

J -OO  J —CO 


= 2tt  S(w-ui')  T(oj), 


(64) 


where  the  first  integral  is  the  delta  function  and  the  covariance  representa- 
tion and  its  inverse  formula  are  given  by 


exp(-i  alt)  4/(w)  dui 


26 


r(t) 


i_ 

27T 


(65a) 


This  is  the  well-known  Wiener-Kintchine  result  for  stationary  processes. 


Equation  64  shows  that  stationarity  is  equivalent  to  assuming  that  the 
spectral  power  is  orthogonal,  i.e., 

f 

Eldg(co)  d'  g*(to')]  » 2tt  6(u)-<iO  ¥(0))  do)  du>',  (66) 


k 


I 


which  implies  that  the  power  in  disjoint  frequency  bands  is  statistically 
uncorrelated.  In  the  context  of  time  evolving  spectra  this  seems  to  imply 
that  on  the  average  energy  is  not  transported  between  bands  and  consequently 
the  power  spectrum  is  constant  in  time.  It  is  also  readily  seen  that  the 
time  dependent  power,  T(0),  is  constant. 

2.  Locally  Wide  Sense  Stationary  Processes 

Silverman^  has  extended  the  concept  of  wide  sense  stationarity  by 
defining  locally  wide  sense  stationary  processes,  i.e.,  processes  that  have  a 
covariance  function  of  the  form 

r(t,  t')  « rx(^)  r2(t-0,  (67) 

where  is  a nonnegative  function  and  is  a stationary  covariance.  We  note 
that  if  r2  is  normalized  to  unity  then  is  the  time  varying  effective  power 

T(t,  t)  - TjU).  (68) 

Substituting  in  Eq.  62b  we  obtain  for  the  generalized  power  spectral  density 


ii 
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¥(co,  u') 


exp[i  (cot-w 


exp[i  (to-w') 


x r2(t-t') 


t')]  r2(t-tO  dt  dt' 

(^~)  + (~~)  (t-t'n 

dt  dt'.  (69) 


Substituting  the  variables  u = (t+t')/2  and  v = (t-t^),  we  obtain 


where 


¥(C0,  UO  = ¥2(~-), 


(70) 


^(u) 


exp(i  cot)  T (t)  dt 


(71a) 


¥2(u) 


- $: 


exp (i  cot)  f2(t)  dt 


(71b) 


rx(t) 


fe  s. 


exp(*-i  cot)  ¥ (10)  dco 


(71c) 


r2(t) 


f 00 

= \ exp(-i  cot)  ¥2(co)  do, 

J — OO 


(71d) 


which  shows  that  a process  with  a locally  stationary  covariance  has  a 
generalized  power  spectral  density  that  is  also  a locally  stationary 
covariance . 

We  note  that  the  locally  stationary  case  reduces  to  the  stationary  case 
if  the  time  varying  power  is  constant,  say  unity, 
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F1  “ 2- 


(72a) 


The  spectral  density  of  is  found  from  Eq.  71a  to  be 


¥1(u)  - 2ir  6 (oj) 


(72b) 


and  we  obtain  from  Eq.  67  and  Eq.  70 


T(t,  t')  - r2(t-t') 


(73a) 


¥(u,  u>')  - 2tt  5(u-a)')  ^(ui) 


(73b) 


which  are  the  same  as  for  the  stationary  case  in  Eq.  63  and  Eq.  64. 

In  the  next  section  we  derive  the  GIPS  for  a nonstationary  second  order 
stochastic  process  and  show  that  it  is  given  by  the  Fourier  transforms  of  both 
the  covariance  function  and  the  generalized  power  spectral  density.  Its 
relationship  to  the  special  cases  of  the  stationary  process,  the  locally 
stationary  process,  and  the  deterministic  process  is  developed  and  we  also 
obtain  an  expression  for  the  variance  of  the  ensemble  of  spectra. 


C.  Nonstationary  Processes 
1.  Spectral  Mean 

The  harmonizability  expressions  in  Eq.  60  can  be  resolved  into  past  and 
future  relations  and  Page's  IES  can  be  extended  directly  to  stochastic 
signals 


G'(t.  w) 


')  exp(i  bit')  dt'\2  . 


r 


This  function  has  the  expected  value 


e| G~(t , 


w:  -v 


x2)  exp  [ i uj (t  1“ t 2 ) ] dT1  dx2  , (75) 


..3 


which  is  similar  to  Lampard  s joint  energy  function  but  we  define  the 
signal  covariance  function  differently. 

Separating  these  integrals  and  making  the  appropriate  variable  changes 
we  obtain 


E G (t,  w) 


■ y -x  r 

J • X, 


dt2  exp [i  to (t  1~t 2 ) ] r^,  t2> 


\ dX2  J dTl 

•1-00  J X 


exp [i  w(t1-t2)]  T(t1,  t2) 


Cc  ft-Ti 

2 Re  j dx^  J dx  f(x^,  x^+x)  exp(-i  wx). 


(76) 


i 

t; 

: 


This  expression  gives  the  mean  energy  distribution  in  frequency  at  time  t, 
i.e.,  the  integral  of  this  function  over  frequency  gives  the  energy  of  the 
past  signal 


S' 


E | G— ( t , w)|  dw 


* S^db  S0  1 * r<V  V'> 

« s: 


dw  exp(-i  tox) 


- E (t). 


(77) 
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V ' 


In  this  calculation  we  note  that  a factor  of  1/2  is  obtained  because  the 
"T"  Integration  is  over  just  1/2  the  support  of  the  delta  function. 

Following  Page  we  define  the  IPS  to  be  the  time  derivative  of  the  IES 


p'(t,  w)  - |-  E|G"(t,  oj)|2  . 


Substituting  the  IES  from  Eq,  76  into  the  IPS  definition  we  obtain 

f° 

p (t,  oj)  - 2 Re  ^ dT^  r(t+T1,  t)  exp (i 


(78) 


(79) 


which  shews  that  the  IPS  of  the  past  signal  is  the  real  part  of  the  Fourier 
transform  of  the  covariance  of  the  past  signal.  The  IPS  inversion  formula 
is  found  to  be 


1 C°°  - if0 

2 ? ) P (t.  w)  exp (-i  urr)  dw  = — J 

x £ j exp[i  io(t1--t)]  dw  r(t+t;L,  t) 

+ ^ exp[-i  w^+t)]  du  r*(t+rlf  t)j 


r(t+r,  t). 

T < 0, 

r(t,  t), 

T - 0, 

r*(t-r,  t). 

T > 0, 

(80) 
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where  only  the  first  or  second  term  of  the  right  member  contributes  for 
T > 0 while  for  T = 0 both  terms  contribute  but  both  integrations  are  over 
1/2  the  support  of  the  delta  function.  These  Fourier  transform  relations 
between  the  IPS  and  the  signal  covariance  in  Eq.  79  and  Eq.  80  are  seen  to 
be  related  to  the  Wiener-Kintchine  relations  for  stationary  processes.  The 
above  expressions  differ  though  because  they  are  time  dependent  and  because 
they  contain  only  information  concerning  the  past  signal. 

Analogous  expressions  can  be  developed  for  the  future  part  of  the 
signal.  The  IES  is  given  by 


E| G+(t , w) | 2 = ^ 

r(T1,  t2) 

exp  [i  to (x T ^ ) ] 

dT1,  dt2 

(81) 

and  manipulating  as  before 

we  obtain 

i O 

e|g  (t,  to)  I = 2 Re 

f° 

\ dT  r(x  , 

Tj+t)  exp(-i  cox). 

(82) 

Jt  1 

Jt-T1 

This  expression  gives  the  mean  energy  distribution  in  frequency  at  time  t, 
i.e.,the  integral  of  this  function  over  frequency  gives  the  energy  of  the 
future  signal 

E | G+  ( t , to)  | 2 dto  * E+(t).  (83) 
The  IPS  is  defined  to  be 


1 


and  substituting  from  Eq.  82  we  obtain 


r 

D+(t,  u)  - 2 Re  j dx.^  rCt-Kj.,  t)  exp(i  lox.^. 


The  IPS  inversion  formula  is  found  to  be 


' ^ J0  dTi 


JOO  f oo 

p+(t,  cj)  exp  (-i  cox)  dw  = J dxx 

x exp[i  w(Tj-t)]  d(u  r(t+x^,  t) 

+ ^ exp[-i  u(t^+t)]  da)  T*(t+r^,  t)^j 

= r(t+T,  t),  x > 0, 

= r(t,  t),  T = o, 

= r*(t-T,  t) , x < 0.  (86) 

Analogous  to  the  expressions  for  the  past  signal  these  Fourier  transform 
relations  between  the  IPS  and  the  signal  covariance  are  related  to  the 
Wiener-Kintchine  relation  for  stationary  processes. 

The  above  expressions  for  the  past  and  future  of  the  signal  can  be 
combined  to  obtain  results  that  relate  both  the  past  and  the  future.  The 
sum  of  the  past  and  the  future  energy  flow  relations  can  be  obtained  from 
Eq.  77  and  Eq.  83  and  vanish 


j 


e|g  (t,  u)|2  + — E|  G+(t , ca)[2J  dw  = 0, 


which  shows  that  the  energv  flow  from  the  future  eauals  the  energy  flow  into 
the  past.  The  difference  of  the  past  and  future  energy  flow  relations  can 
be  obtained  from  Eq.  80  and  Eq . 86: 


^ [|^  E|G  (t,  w)|2  - E|G+(t,  w)|2]  dw  = 2 T(t,  t);  (88) 


this  is  twice  the  signal  power  and  shows  that  the  GIPS  can  be  defined 


p(t,  u>)  = j [E|G~(t,  u)  |2  - E|G+(t,  co)  |2], 


Substituting  the  IPS  from  Eq.  79  and  Eq.  85  we  obtain 


p(t,  u>)  = Re 


dx  r(t+x,  t)  exp (i  ujt)  , 


which  shows  that  the  GIPS  is  given  by  the  Fourier  transform  of  the  covariance 
function.  This  result  is  the  Wiener-Kintchine  relation  generalized  to  the 
case  of  nonstationarv  processes.  The  inverse  relations  are  given  in  Eq.  80 
and  Eq.  86.  Inspection  shows  that  the  inverse  relations  do  not  give  a 
covariance  that  is  necessarily  even  in  the  time  shift  parameter,  T,  which 
of  course  must  be  the  case  for  a nonstationarv  process.  This  is  in  contrast 
to  Lampard 's^  result.  In  addition  we  can  relate  the  GIPS  to  Loeve's  generalized 
power  spectral  density  for  nonstationarv  second  order  random  processes  by  sub- 
stituting directly  from  Eq.  62a: 


34 


p(t,  U>) 


f 00 

^ \ dci)'  ^(u),  aT)  exp [i  (u)'-to)t]. 

27T  J 


(91) 


We  find  that  the  GIPS  is  given  by  the  Fourier  transform  of  the  generalized 
power  spectral  density.  In  the  remainder  of  this  section  we  show  that  the 
GIPS  is  a general  result  that  represents  a number  of  special  interest  cases 

For  the  case  of  stationary  processes  the  generalized  power  spectral 
density  is  orthogonal  on  disjoint  bands  as  shown  in  Eq.  64  and  the  GIPS  in 
Eq.  91  becomes 


p(t,  u)  - H'(w) . (92) 

The  covariance  function  is  a function  of  time  differences  only  as  in  Eq.  63 
and  the  covariance  in  Eq.  90  becomes 

r(t+T,  t)  - E[s (t+x)  s*(t)] 

- T(t).  (93) 


c 


tfith  Eq.  92  and  Eq.  93  the  GIPS  in  Eq.  90  becomes 


s 


f(w)  - Re  \ dx  T(t)  exp(i  oot) 


(94a) 


This  expression  is  readily  inverted  to  obtain  the  covariance  representation 


T(t) 


du>  'f'(co)  exp(-i  ojt)  , 


(94b) 


and  this  Fourier  transform  pair  is  the  Wiener-Kintchine  theorem  as  in  Eq.  65. 


L 
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For  the  case  of  locally  stationary  processes  the  generalized  power 
spectral  density  separates  into  a locally  stationary  covariance  as  in  Eq.  70 


\ 


. 


and  the  GIPS  in  Eq.  91  becomes 

/•  °o  y 

p(t,  cu)  = \ du)"  Y (cu-cuO  V (^y— ) exp [ i (cu'-cu)t] 

J —00 

= Re  ^ dt'  r (t+t'/2)  T At')  exp  (i  cut ') , (95) 

where  we  have  substituted  from  Eq.  71a  and  Eq . 71b.  This  last  result 
could  have  been  obtained  directly  from  the  GIPS  expression  in  Eq . 90  by 
using  the  locally  stationary  covariance  definition  in  Eq . 67. 

For  the  case  of  deterministic  signals  the  covariance  function  has  the 
simple  form 


r(t+T,  t)  = s(t+T)s*(t), 


and  the  GIPS  in  Eq.  90  becomes 


p(t,  cu)  = Re  \ dt  s(t+x)  s*(t)  exp(i  cut) 
J — CO 

= Re  s(t)  exp(i  cut)  S*(io), 


(96) 


(97) 


which  is  the  same  as  we  obtained  in  Eq.  34f.  This  result  shows  that  our 
apparent  conflict  in  terminology  is  only  apparent,  i.e.,  we  have  been  using 
the  term  GIPS  for  both  the  spectrum  of  a deterministic  signal  and  the  mean 
spectrum  for  nonstationary  processes.  The  above  calculation  illustrates  that 


36 


I 
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both  usages  are  correct  and  that  the  deterministic  signal  is  just  a special 
case  of  the  nonstaticnary  random  process. 

2.  Spectral  Variance 

The  GIPS  is  the  spectral  mean  of  a nonstationary  random  process.  Since 
an  estimate  of  the  GIPS  is  more  easily  obtained  if  the  variance  of  the  estimate 
is  small,  it  is  important  to  have  a theoretical  expression  for  computing  this 
quantity.  In  the  following  we  show  that  the  spectral  covariance  can  be 
bounded  by  the  double  Fourier  transform  of  the  covariance  of  the  estimate  of 
the  signal  covariance.  The  spectral  variance  is  readily  obtained  from  this 
result . 

The  covariance  of  the  GIPS  is  given  by 

2 

A2p(t,t',w)  - i 113^  En(|G"(t,  co)|2  - |G+(t,  CO)  I2) 

~(e| G~(t , co)|2  - E | G+  ( t , io)|2)] 
x t(|G"(t',  co)|2  - |G+(t',  co)|2) 

-(E|G'(t',  co)  |2  - E|G+(t',  to)  |2)]} 

- A2p  (t,t',<o)  + A2p±(t,t',co)  + A2p+(t,t',w) , 

2 t.  . . 

+ A p (t,t  ,(0)  , /qQ\ 


where  we  define  the  covariances  as 


AV(t,tVo)  = 


E[(|G"(t,  u>) | - E | G~(t , u)|2) 


2=  9^  I 

A p (t.t'.w)  - E Re  3 dTl  )0  dT  fS^Tl^  S*(T1+T)-r(T1,T1-K)  ] 

X exp(-i  wx)  Re  ( dx'  ( 1 dx' 

J -CO  1 Jo 

[s*(Tps(T'+T')-r*(T',T'+T>)]  exp(i  wx') 

* E | Re  ^ dT^  [sCt^)  s*(t)-r(T1,  t)  ] exp(-i  oj(t-T^)) 
x Re ^ dxp  [s*(Tps(t')-r*(Tr,  t')]  exp(i  a)(t'-x')) 

J —CO 

c° 

- E Re  \ dx^  [sCt+Xj)  s*(t)-r(t+x,  t)]  exp(i  wXj) 

J —CD 

(° 

X Re  \ dxp  [s*(t'+xp  s(t')-r*(t'+x',  O]  exp(-iux') 

J —£D  ^ 

c°  c° 

- E[ (Re  \ dx  I(t,x,u)))  (Re  \ dx"  I*(t",x',ai))  ] , 

J - CO  J rm 


(101a) 


where  we  define  the  function 


I(t,x,w)  =*  [s(t+x)  s*(t)  - T(t+x,  t)  ] exp(i  ojx) . 


By  similar  methods  the  remaining  three  terms  are  given  by 
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2 + fO 

A p (t,t  ,uj)  - E[  (Re  V dT  I(t,T  ,w))  (Re  \ dT " I*  (t " ,T " ,oj)  ) ] (101b) 

Jo  J — < OO 

2 + f 10 

Ap  (t,t  ,u)  = E[  (Re  \ dT  I(t,T,u))(Re  \ dt"  I*  (t ",t  ",<j)  ) ] (101c) 

J-oo  J o 

2 t f°°  f°° 

A p (t,t  ,w)  = E[(Re  \ dT  I (t  ,T  ,u) ) (Re  V dx  " I*  (t  " ,T  ",u>)  ) ] , (lOld) 

J 0 JO 

where  Eq.  81  and  the  method  of  integration  leading  to  Eq.  82  is  used. 

Combining  terms  the  GIPS  covariance  expression  becomes 

2 ..  I ( °° 

A p(t,t  ,w)  - E Re  \ dT  [s(t+T)  s*(t)  - r(t+T,  t)]  exp (i  or) 

I J —OO 

x Re\  dT"  [s*(t"+x")  s(t")  - r*(t"+r',t')]  exp(-i  wt")  , 

J _£0  I 

(103) 


which  shows  it  explicitly  to  be  the  covariance  of  the  ensemble  of  spectra. 
This  expression  can  be  expanded  but  it  is  more  convenient  to  obtain  a simple 
bound  on  the  GIPS  covariance  which  is  given  by 


A p(t,t",w)  < 


dT  dt"  E{[s(t+T)  s*(t) 


- r(t+x,  t)] 


x [s*(t"+T")  S ( t ")  - r*(t'+T',t")  ]} 


x exp(i  w(t-t")). 


(104) 


This  bound  is  the  double  Fourier  transform  of  the  covariance  of  the  estimate 
of  the  signal  covariance  and  is  also  the  covariance  of  the  phasor  representation 


of  the  GIPS.  If  the  phasor  representation  is  uniformly  distributed  about  the 

mean  phasor,  then  the  variation  of  the  random  GIPS  is  expected  to  achieve  the 

upper  bound  for  at  least  some  t,  t”,  and  oj  and  the  bound  is  a useful  one.  We 

2 

note  further  that  the  spectral  variance  is  given  by  the  function  A p(t,t,w). 

D.  Estimation  of  the  GIPS  by  the  Sliding  FFT 

Frequently  it  will  be  more  convenient  to  estimate  the  GIPS  by  means  of  the 
Sliding  FFT  rather  than  by  means  of  the  covariance  function.  Since  we  have 
previously  seen  that  the  Sliding  FFT  algorithm  produces  a smoothed  version  of 
the  GIPS  it  is  important  to  determine  its  effects  on  our  estimate  and  its 
variance. 

From  Eq.  55  we  find  the  estimate  of  the  GIPS  to  be 


p(t,  oj)  = — E[s (t)  exp(i  cut)  F*(u)]  s(t,  ui)  , 


(105) 


where  we  define  the  smoothing  function  as 


s (t , u))  - sinc[  (uj-Wq-o^)  t]  sinc[Aw(t-t^)  ] . 


(106) 


By  previously  used  methods  we  obtain 


p(t,  w) 


[*  C.  *- 


T(t+t',  t)  exp(i  tot')  s(t,  u>) , (107) 


which  is  a smoothed  version  of  the  GIPS. 


The  covariance  of  the  estimate  is  given  by 


which  is  the  same  as  the  covariance  expression  in  Eq.  103  with  the  exception  of 
the  smoothing  factor  introduced  by  the  Sliding  FFT.  Consequently,  we  see  that 
estimates  of  the  GIPS  obtained  via  the  Sliding  FFT  will  be  distorted  by  the 
smoothing  window  in  both  its  mean  and  variance. 
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IV.  SUMMARY  AND  CONCLUSIONS 

We  have  seen  that  conventional  spectral  analysis  methods  by  Fourier 
decomposition  do  not  lead  to  results  that  are  in  agreement  with  the  intuitive 
notion  that  signals  evolve  in  frequency  as  well  as  in  time.  This  deficiency 
is  due  to  the  infinite  limits  of  integration  on  the  Fourier  integral  and 
can  be  eliminated  by  defining  a Fourier  transform  in  which  the  integration 
limits  cover  just  the  past  signal.  This  definition  of  a time  evolving 
transform  is  used  to  compute  the  instantaneous  energy  and  instantaneous  power 
spectrum  of  the  past  signal  and  these  functions  are  directly  measureable  in 
real  time.  These  functions  contain  no  information  concerning  the  future 
signal  but  such  functions  can  be  readily  defined  from  the  Fourier  transform 
in  which  the  integration  limits  cover  just  the  future  signal.  These  future 
signal  expressions,  which  can  only  be  estimated  after  the  event,  contain  no 
information  concerning  the  past  signal  but  by  combining  with  the  past  signal 
expressions  can  be  used  to  define  the  GIPS  that  contains  information 
concerning  both  the  past  and  the  future  signal. 

The  GIPS  is  usually  calculated  by  means  of  the  Sliding  FFT  algorithm  or 
some  variation  thereof.  The  function  generated  by  the  Sliding  FFT  algorithm 
is  found  to  be  a smoothed  version  of  the  GIPS  in  which  the  smoothing  is  typically 
over  a time- frequency  domain  of  size  Aid  At  > 1/2.  On  the  positive  band  of 
frequencies  this  function  is  an  approximation  of  the  GIPS  of  both  the  analytic 
signal  and  the  real  signal  whether  the  algorithm  is  applied  to  the  analytic 
signal  or  to  the  real  signal.  This  shows  that  the  result  of  a theoretical 
spectral  analysis  that  is  based  upon  the  analytic  signal  can  be  approximately 
compared  to  the  function  generated  by  the  Sliding  FFT  even  though  applied  to 
the  real  signal.  This  is  important  because  theoretical  analyses  based  upon  the 
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analytic  signal  are  generally  simpler  while  the  Sliding  FFT  is  most  conveniently 
applied  to  the  real  signal. 


The  concepts  derived  for  the  deterministic  signal  are  readily  extended  to 
the  case  of  nonstationarv  stochastic  ensembles  of  signals.  The  GIPS  of  the 
ensemble  is  found  to  be  a generalization  of  the  Wiener-Kintchine  theorem 
to  the  case  of  nonstationary  processes.  It  is  also  found  to  be  given  by  the 
Fourier  transform  of  Loeve's  generalized  power  spectral  density  of  a second 
order  nonstationary  process  and,  in  addition,  is  found  to  represent  the  special 
cases  of  the  stationary  process,  the  locally  stationary  process,  and  the  deter- 
ministic process.  In  addition  to  the  GIPS  of  the  ensemble,  i.e.,  the  mean  of 
the  spectrum  ensemble,  the  covariance  of  the  spectrum  ensemble  is  also  required 
and  a simple  bound  is  shown  to  be  given  by  the  double  Fourier  transform  of  the 
covariance  of  the  signal  covariance  estimate.  Since  these  expressions  for  the 
GIPS  and  the  spectral  covariance  require  that  the  signal  covariance  be  known, 


they  are  primarily  of  theoretical  interest.  However,  it  is  also  shown  that 
estimates  of  the  GIPS  by  means  of  an  ensemble  of  Sliding  FFT  calculations  will 


be  a smoothed  version  of  the  correct  GIPS  and  the  covariance  of  the  ensemble 


is  a smoothed  version  of  the  correct  covariance. 
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